A POMDP-based Multimodal Interaction System Using a Humanoid Robot
نویسندگان
چکیده
In recent years, with the spread of the household robots, the necessity to enhance the communication capabilities of those robot to people has been increasing. The objective of this study is to build a framework for a dialogue system dealing with multimodal information that a robot observes. We have applied partially observable Markov Decision Process to modeling multimodal interaction between a human and a robot. Through the experiments, we have confirmed that our proposed framework functions properly and achieves effective multimodal interaction with a robot.
منابع مشابه
Flexible Foot/Ankle Based on PKM with Force/Torque Sensor for Humanoid Robot
This paper describes the development of a novel humanoid robot foot/ankle based on an orientation Parallel Kinematic Mechanism for intelligent and flexible control. With three identical Universal-Prismatic-Spherical prismatic-actuated limbs and a central Universal-Revolute passive limb, the PKM can perform three degrees of freedom rotation motions. In order to enable the humanoid robot safely t...
متن کاملMotion capture-based wearable interaction system and its application to a humanoid robot, AMIO
In this paper, we present a wearable interaction system to enhance interaction between a human user and a humanoid robot. The wearable interaction system assists the user and enhances interaction with the robot by intuitively imitating the user motion while expressing multimodal commands to the robot and displaying multimodal sensory feedback. AMIO, the biped humanoid robot of the AIM Laborator...
متن کاملA Framework for the Acquisition of Multimodal Human-Robot Interaction Data Sets with a Whole-System Perspective
In this work we present a conceptual framework for the creation of multimodal data sets which combine human-robot interaction with system-level data from the robot platform. The framework is based on the assumption that perception, interaction modeling and system integration need to be treated jointly in order to improve human-robot interaction capabilities of current robots. To demonstrate the...
متن کاملEnabling Multimodal Human-Robot Interaction for the Karlsruhe Humanoid Robot
In this paper, we present our work in building technologies for natural multimodal human–robot interaction. We present our systems for spontaneous speech recognition, multimodal dialogue processing, and visual perception of a user, which includes localization, tracking, and identification of the user, recognition of pointing gestures, as well as the recognition of a person’s head orientation. E...
متن کاملSituated Interaction in a Multilingual Spoken Information Access Framework
The paper describes aspects of situated interaction when a humanoid robot uses the WikiTalk system as a spoken language dialogue interface. WikiTalk is a speech-based open-domain information access system that enables the user to move around Wikipedia from topic to topic and have chunks of interesting articles read out aloud. The interactions with the robot are situated: they take place in a pa...
متن کامل